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Abstract — We propose a simple modification to the recently 
proposed compressive binary search (T). The modification removes 
an unnecessary and suboptimal factor of log log n from the 
SNR requirement, making the procedure optimal (up to a small 
constant). Simulations show that the new procedure performs 
significantly better in practice as well. We also contrast this 
problem with the more well known problem of noisy binary 
search. 

I. Introduction 

The recently proposed compressive binary search (CBS) 
algorithm fTl aims to determine the location of a single non- 
zero entry in a vector x £ M" using m adaptive linear 
projections of the form 

yi = {ai,x) + Zi i = l,...,m 

where a.; G M" are sensing vectors with ||ai|| = 1 and Zi 
are i.i.d. Af{0, 1). The CBS algorithm proposed in U] finds 
the non-zero entry with vanishing probability of error as n 
gets large provided fj, > Cy^{n/m) loglog2 n where /i is the 
amplitude of the non-zero entry. A bit more precisely. Theorem 
1 in im states that Pg < 6 provided 
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where Pe is the probability the procedure fails to return an 
index corresponding to the non-zero entry. The dependence 
on 5 is to be expected, but the authors of |[0 rightly question 
whether the log log2 n term is needed. The main contribution 
of this paper is a simple modification of the algorithm pro- 
posed in im which eliminates this unnecessary and suboptimal 
dependence on n. 

II. Main Result 

The CBS algorithm proposed in |[T] operates as follows. 
The algorithm consists of sq = log2 n steps (as in |[T] we 
assume n is dyadic). At each step of the algorithm, indexed 
by s, measurements are taken on progressively smaller dyadic 
subintervals of {l,...,n}. The sensing vectors are discrete 
Haar wavelets, and the sign of each measurement gives an 
indication of whether the non-zero entry is in the right or left 
half-interval of the wavelet's support. The CBS algorithm is 
outlined in Fig. [T] 

Since the sensing vectors have unit norm, the magnitude of 
the non-zero entries of the sensing vectors grow as the algo- 
rithm proceeds from coarse-to-fine wavelets. Consequently, the 



Compressive Binary Search (CBS) 

number ot steps: sq :— iogj n 

measurements per step: nis , with X]s=i '^^ — "^ 



initial support: Jg :- 

for s = 1, . . . , So 



{!,...,«} 



1) split: Jj; and Jj , left and right subinterval of Jq 

2) sensing vector: u'"' = 2-(^"-''+^)/^ on j{"\ 
u(=) = _2-(''o-'=+i)/2 on j^«)^ a„(j otherwise 

3) measure: y^"' = {u''-^\x} + zl"' , 



(=) 



4) update support: Jq 
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TTls (s) 



and 4"+''' 



jr^fj:T=iyr>o 



Jj otherwise 



end 

output: J,j " (a single index) 



Fig. 1. Compressive Binary Search algorithm. 



SNR of the measurements grows exponentially as the proce- 
dure progresses. In [1], the authors divide the m measurements 
among the steps as follows. For s = 1, . . . , sq 
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+ 1, m, = [(m-so)2-"J 



It is easy to check that X^sli "^s — "^- This allocation roughly 
equalizes the SNR at each step. If /i satisfies ([T]), then the CBS 
algorithm is guaranteed to have a probability of error of at 
most S/sq at each step (and the union bound yields an overall 
probability of error of at most S). 

Here, instead, we allocate the m measurements as follows: 



771, := 777, 



1, 



(777 - So) S 2-('' + l) 



Again, it is easily verified that X]s=i "^s — "^- With this 
allocation, the probability of error is at most a constant 
times 2^^ at each step; i.e., the probability of error decreases 
exponentially over the steps, rather than remaining constant 
as above. This simple modification is enough to eliminate the 
log log2 77 term in the bound in ilj . 



Theorem 1. If ■m>2 log2 n and 
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then X^sLi "^s £ fn and the CBS algorithm succeeds with 



< S provided magnitude of the non-zero entry satisfies 
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Proof: The total measurement budget satisfies 

So sa sa 

> nrig = So + / "Is !i So + [m — Sq) y s 2^'^*^ ' < m, 

s — l s— 1 s — 1 

since X)sli s2~('*+^) < 1. By the union bound and a Gaussian 
tail bound, the total error probability satisfies 
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Since nis > {m — so)s2 ('*+i) and m > 21og2n = 2so, we 
conclude tti, > ^s2~(*+^) and thus 
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Letting ^ > /iJ2ii log 2^ + 1 yields 
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Remark 1. The authors of jT] also show that no procedure 
can succeed at the compressive binary search problem with 
probability greater than 1/2 if /x < ^Jnlni. Using the new 
allocation of measurements, the CBS algorithm succeeds with 
probability greater than 1/2 if /i > ■\/l61og(2)n/m, within a 
small constant factor of the lower bound. 

Remark 2. An algorithm similar to CBS was proposed in 
121 as a special case of a more general approach to the 
adaptive sensing problem, although control of the SNR across 
measurement steps is not discussed. Additionally, the authors 
in Is] suggest and analyze an adaptive group testing procedure 
with many of the main ideas of CBS. The adaptive group 
testing procedure also has a sub-optimal log log n dependence. 

Remark 3. The CBS problem is closely related to the so- 
called noisy binary search problem ||4l-||7l- Noisy binary 
search addresses a version of the classic binary search problem 
with binary noise. If the SNR is equal in each step of CBS 
(as in II]), then it is equivalent to the "naive" noisy binary 
search algorithm discussed in fT\, which also suffers from 
the suboptimal log log2 n factor More sophisticated algorithms 
such as Horstein's algorithm ||4]-||6] and binary search with 
backtracking fT\ are optimal to within constants. The CBS 
problem, however, is different from noisy binary search in that 
more localized measurements (or "queries") are more reliable. 



Because of this unique feature, the optimal algorithms for 
noisy binary search do not yield optimal solutions for the CBS 
problem. Instead, all that is needed to eliminate the log log2 n 
factor is a measurement allocation that properly exploits the 
fact that more localized measurements have a larger SNR. 
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Fig. 2. Numerical Simulation. Empirical perfoimance of CBS (both original 
and modified) as a function of /i for n = 4096 and m = 256. 10,000 trials. 
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